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ABSTRACT 

It  is  shown  that  the  dual  of  the  problem  of  minimizing  the  2-norm  of  the 
primal  and  dual  optimal  variables  and  slacks  of  a  linear  program,  can  be 
transformed  into  an  unconstrained  minimization  of  a  convex,  parameter- free , 
globally  differentiable,  piecewise  quadratic  function  with  a  Lipschitz 
continuous  gradient.  If  the  slacks  are  not  included  in  the  norm  minimization, 
one  obtains  a  minimization  problem  with  a  convex,  parameter- free,  quadratic 
objective  function  subject  to  nonnegativity  constraints  only. 
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SIGNIFICANCE  AND  EXPLANATION 


The  linear  programming  problem  is  that  of  maximizing  a  linear  objective 
function  subject  to  linear  inequalities  and  equalities .  Such  problems  are 
usually  solved  by  methods  which  move  from  a  vertex  to  a  higher  neighboring 
vertex  in  the  feasible  region  and  terminate  in  a  finite  number  of  steps .  In 
this  report  we  show  how  the  smallest  solution  of  a  linear  program  can  be 
obtained  by  the  completely  unconstrained  minimization  of  a  valley-like  smooth 
function.  This  reformulation  should  enable  us  to  use  other  techniques  to 
solve  this  fundamental  problem. 
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LEAST-NORM  LINEAR  PROGRAMMING  SOLUTION  AS  AN  UNCONSTRAINED  MINIMIZATION  PROBLEM 


O.  L.  Mangasarian 


1 •  Introduction 

In  general  the  primal-dual  solution  to  a  linear  program  is  not  unique  and  sometimes 
the  set  of  such  solutions  is  unbounded  in  which  case  the  problem  is  unstable  Its).  It 
seems  reasonable  then  that  given  a  linear  program  one  would  be  interested  in  finding  a 
unique  solution  with  some  least  norm  property.  In  this  work  we  will  show  that  if  one 
chooses  that  optimal  solution  which  minimizes  the  2-norm  of  the  primal  and  dual  optimal 
variables  and  slacks  one  is  led  to  an  unconstrained  minimization  of  a  convex,  parameter- 
free,  globally  differentiable,  piecewise-quadratic  function  with  a  Lipschitz  continuous 
gradient.  If  the  slacks  are  not  included  in  the  norm  minimization,  one  obtains  a  minimiza¬ 
tion  problem  with  a  convex,  parameter- free,  quadratic  objective  function  subject  to 
nonnegativity  constraints  only.  These  reformulations  of  the  original  linear  program  can  be 
solved  by  techniques  other  than  the  simplex  method  and  will  lead  to  a  unique  least-norm 
solution  of  the  problem. 

We  shall  consider  the  canonical  linear  program 

T 

maximize  c  x  subject  to  y  =  -Ax  +b,  (x,y)  >  0  (1) 


where  c  and  b  are  given  vectors  in  the  real  dimensional  Euclidean  spaces  Rn  and  Rm 

respectively,  A  is  a  given  m  x  n  real  matrix  and  the  superscript  T  denotes  the 

transpose.  The  dual  linear  program  [3)  associated  with  (1)  is 

T  T 

minimize  b  u  subject  to  v  =  A  u  -  c,  (u,v)  >  0  .  (2) 

(u,v)  R 

It  is  well  known  [3)  that  solving  either  (1)  or  (2)  is  equivalent  to  solving  both  (1)  and 
(2)  which  in  turn  is  equivalent  to  the  following  linear  complementarity  problem  [2): 
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Find  (z,w)  in  R^  such  that 


T  T 

w  =  Mz  +  q  >  0,  z  >  0,  z  w  “  q  z  “  0 


where 


k  •  n  +  m,  M 


0  A 

-A  0 


-c 

b 


(3) 


(4) 


T  T 

Note  that  M  is  a  skew  symmetric  matrix  satisfying  M  +  M  »  0  and  hence  z  Mz  “  0  for 

V 

any  z  in  R  .  A  principal  purpose  of  this  work  is  to  show  (Theorem  1)  that  the  least  2- 

norm  solution  (z,w)  of  problem  (3)  can  be  obtained  by  solving  the  following  unconstrained 

k+1 

minimization  problem  in  R 


minimize  f(r,a) 
(r,a)f  R 


(5) 


where 

f(r,a)  :=  qTr  +  j  I  (MTr  -  aq^l*  +  \  <  (~r)^*|  .  (6) 

k  k 

Here  l»l  denotes  the  2-norm  and  for  t  in  R  ,  (t)  +  denotes  a  vector  in  R  with 

components  ( < t)+)  *  max{ti#0},  i  =  1,...,k,  where  is  the  ith  component  of  t.  It 

k+1 

is  easy  to  verify  that  f(r-a)  is  a  convex,  globally  differentiable  function  on  R  .we 

k+i 

will  also  show  that  f  has  a  Lipschitz  continuous  gradient  on  R  .In  fact,  it  will  be 
shown  that  the  unconstrained  minimization  problem  (5)  is  equivalent  to  the  dual  of  the 
least-norm  problem 

12  T 

minimize  {—  lz,wl  |w  =  Mz  +  q  >  0 ,  z  >  0 ,  q  z  -  0}  .  (7) 

,  ,  „2k 

(z,w)e  R 

We  will  also  show  the  value  a,  where  (r,a)  is  a  solution  of  the  unconstrained  problem 

(5),  plays  an  important  role  in  interpreting  the  stability  of  least-norm  solution  of  (3) 

and  hence  of  (1)-(2)  (Corollary  3). 

By  considering  the  dual  of  a  slightly  different  least-norm  problem 

12  T 

minimize  {—  Izl  |Mz  +  q  >  0,  z  >  0,  q  z  “  0}  (8) 

2  2 

zeR 


we  are  led  (Theorem  2)  to  the  following  convex  quadratic  minimization  problem  with 


nonnegativity  constraints  only 


min  jmi  zf> 


(9) 


where 

g(s,t,B>  qTs  +  j  IMTs  -  Bq  +  tl*  .  (10) 

Here  again  the  value  B  of  B  for  which  (9)  has  a  solution  can  be  interpreted  as  a 
stability  measure  for  the  dual  linear  program*  (1)-(2)  (Corollary  5). 

T 

He  note  that  since  the  oonditions  Mz  +  q  >  0 ,  z  >  0  imply  that  q  z  >  0  it  follows 

that  in  both  problems  (7)  and  (8)  the  last  constraint  qTz  0  can  be  written  in  the 

T  T 

equivalent  form  q  z  <  0.  Thus  the  Lagrange  multiplier  associated  with  q  z  >0  is 

implicitly  nonnegative . 

The  formulations  (5)  and  (9)  have  computational  implications.  Thus  the  unconstrained 
minimization  problem  (5)  can  be  solved  by  gradient  and  possibly  other  methods  (8]  while  the 
quadratic  problem  (9)  can  be  solved  by,  among  others,  iterative  successive  overrelaxation 
methods  [11 J.  These  aspects  are  discussed  in  Section  4. 
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2 .  The  least-norm  linear  programming  solution  as  an  unconstrained  minimisation  problem 
We  begin  by  establishing  the  following  useful  preliminary  result. 

Ic  £ 

Lemma  1 .  Let  S  C  R  ,  let  h:S  ♦  R  ,  let  8:R  ♦  R  and  let  •f  be  a  nondecreasing 

l 

function  from  the  nonnegative  real  line  into  R.  Let  1*1  be  any  monotonic  norm  on  R 

£ 

that  is  for  a  and  b  in  R  ,  lal  <  Ibl  whenever  |  a  ^  |  <  Ib^l,  i  =  1, Then 


(i)  x  solves  min  8(x)  +  ^<lh(x)+l)  ==> 
xes 


(11)  x  solves  min  0(x)  +  i(lh(x)  I) 
xeS  + 


and  the  two  minima  are  equal 


(ill)  (x,y  «  h(x)+  -  h(x))  solves 


min  0(x)  +  *>(lh(x)  +  yl ) 

xcS 

y>0 


(x,  y  =  h  ( x )  +  -  h(x))  so lve s 

min  8(x)  +  v>dh(x)  +  yl  ) 

xes 

y>0 


and  the  two  minima  are  equal 


(x,y)  solves 

min  0(x)  +  ^dh(x)  +  yl) 

xes 

y>0 


(x,y)  solves 

min  8 ( x)  +  ^(lh(x)  +  yl)  . 

xes 

y>0 


Proof .  (i)  Let  x  solve:  min  0(x)  +  £(lh(x)+l),  let  y  -  h(x)+  -  h(x),  let  x  e  S 

xes 

and  let  y  >  0 .  Then 

9  (  x)  +  *•  d  h  (  x )  +  yl)  -  8  ( x)  -  <dh(x)  +  yl ) 

*  0(x)  +  idh(x)  +  yl)  -  0(x)  -  ^(lh(x)+l)  (By  definition  of  y) 

>  0(x)  +  v'(lh(x)  +  yl)  -  0(x)  -  lh(x)  l)  (By  definition  of  x) 

>  0  (By  norm  mono  ton  lcity ,  nondecreasing  property  of  •f  and 

(h^fx)  +  y I  >  h,  (x)  +  ,  i  *  1, . 


The  two  minima  are  equal  by  the  definition  of  y. 
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(ii)  Let  (x,y)  solve  min  8(x)  +  ^(th(x)  +  yl)  and  let  x*  S.  Then 

xes ,y>0 


9(x)  +  *>(lh(x)+l)  <  8(x)  +  ^(lh(x)  +  yl) 

(By  norm  monotonicity,  nondecreasing  property  of  <t 


and  1  ( x)  +  y^  |  >  hi<x)  +  ,  i  -  1,...,i) 

<  9(x)  +  ^(Ih(x)  +  yl)  for  y  >  0 
(By  definition  of  (x,y)) 

=  9  (x)  +v>(lh(x)  I)  (Set  y  -  h(x)+  -  h(x)  >  0)  . 

The  two  minima  are  equal  because  by  part  (i),  x  and  y  =  h(x)+  -  h(x)  solve 

min  8  ( x)  +  v? ( I h ( x)  +  yl )  . 

xes 

y>0 

(iii)  Thie  part  follows  by  combining  parts  (i)  and  (ii)  of  the  lemma.  □ 

We  are  ready  now  to  establish  our  first  principal  result. 

Theorem  1  .  The  dual  linear  programs  (1)  and  (2)  are  solvable  if  and  only  if  the 
unconstrained  minimization  problem  (5)  is  solvable.  For  any  solution  (r ,a)  of  (5)  the 
point  (z,w)  defined  by 


:=  (Hr  -  aq)+,  w  :=  (-r)  + 


is  the  unique  point  in  rrK  which  solves  (3),  the  dual  linear  programs  (1)-(2)  and  the 
minimum-norm  problem  (7) .  Furthermore 


min  f(r,a) 
,  „k+1 


(r,a)eR 


12  T 

min  {—  Iz/wl^lw  “  Mz  +  q  >  0,  z  >  0,  q  z  =  0}  .(12) 

(z,w)e  R2* 


Proof .  If  the  solution  set  of  (3)  is  nonempty  then  by  quadratic  programming  duality  14,10] 


we  have  that 


1 


r  1  2  T 

min  {—  Iz/Wl  |w  -  Mz  -  q  *  0,  w  >  0,  z  >  0,  q  z  *  0} 

,  .  „2k  2 

(z  ,w)e  R 

_  _  max  {-  \  <MTr  -  aq  +  l-r  +  al*  “  qTr|(a,d)  >  0)  (13) 

3k +1 

<r,a,d,a>e  rj* 

1  .  ...T 


min  f  KM‘r  -  aq)  I2  +  r  K-r)  1^  +  qT r 

,  >  „k+1  2 

(r,a)f R 


(5) 


(By  Lemma  1) 


min  f(r,ci) 

k+1 


(r  ,a)e  R 


Suppose  first  that  the  dual  linear  programs  (1)-(2)  are  solvable.  Then  the  solution 
set  of  (3)  is  nonempty  and  contains  a  unique  (z»w)  in  R2**  that  solves  (7).  By  Dorn's 
duality  theorem  [4,10  Theorem  8.2.4]  there  exists  (r,a,d,a)  in  R3lt+1  that  solves  (13) 
above  and  by  Lemma  1,  (r,a)  solves  (S)  and 

-  J  l*,wl2  -  f(r,a)  . 

Conversely  now  suppose  that  (r,a)  solves  (S)  .  Then  again  by  Lemma  1,  (r,a)  and 

d  =■  (M*^r  -  aq)+  -  (M^r  -  aq) ,  a  =  (-r)  “  (*r) 

solve  (13)  and  by  Dorn's  strict  converse  duality  theorem  [4,10  Theorem  8.2.5)  . 

—  P-  —  —  p—  — 

z=Mr-aq+d-  (Mr-  aq)+ 
w  *  -r  +  a  =  (-r)  + 

2k 

is  the  unique  point  in  R  which  solves  (7)  and  hence  the  dual  linear  programs  (1)-(2)« 
We  again  have  that 

f (r ,o)  ‘  -  \  'z,w»2  .  □ 

Because  problem  (5)  is  an  unconstrained  minimization  problem  with  a  convex 
differentiable  objective  function  its  solution  can  be  achieved  by  setting  the  gradient 
Vf(r,a)  equal  to  zero,  we  thus  have  the  following. 


i 
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Corollary  1  .  The  dual  linear  programs  (t)  and  (2)  are  solvable  If  and  only  if  there  exist 


-  k  +  1 

(r,a)  e  R  satisfying 


7f(r,a)  = 


'  q  +  M(M^r  -  aq)  +  -  (-r)  +  “  0 


v-qT(MTr  -  aq)+  "  0  . 


(14) 


(15) 


For  any  (r,a)  satisfying  (14)— (15)  the  point  (z,w)  defined  by  (11)  is  the  unique  point 
2k 

in  R  which  solves  (3),  the  dual  linear  programs  { 1 )  —  ( 2 )  and  the  minimum-norm  problem 
(7)  . 

An  interesting  property  of  the  unconstrained  minimization  problem  (5)  is  that  the 
minimization  over  the  variable  a  can  be  dispensed  with  if  a  is  chosen  sufficiently 
large.  This  can  be  established  by  using  the  perturbation  results  of  linear  programming 
[13]  as  follows. 

Corollary  2.  Let  {z|Mz  +  q  >  0,  z  >  0}  be  nonempty  and  let  f  be  defined  by  (6).  There 
exists  an  a  >  0  such  that 


min  f(r,al  »  y(a)  for  a  >  a 


(16) 


(r,a)eR 


k+1 


where 


^(a)  min  f(r,a) 
k 

reR 


(17) 


is  well  defined,  continuous  and  convex  for  all  real  a  and 
*(0)  =  - 


1  2 

min  {—  lz,wl  |w  =  Mz  +  q  >  0,  z  >  0}  , 
,  ,  -2k 

(Z,W)CR 


(18) 


12  T 

iO(a)  =  -  min  (j  lz,wl  |w  =*  Mz  +  q  >  0,  z  >  0,  q  z  ■  0}  for  a  >  a  .  (19) 

2k  i  i  - 

(z,w)«  R 
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Proof • 


12  T 

f(r,a)  =  -  min  {—  lz,wl  |w  =  Mz  +  q  >  0,  z  >  0,  q  z  <  0}  (20) 


( r  ,a)e  R 


k+1 


(z,w)e  R' 


2k 


(By  (12)) 


T  1  2 

min  {aq  z  +  —  Bz.wll  |w  =  Mz  +  q  >  0,  z  >  0} 

,  ,  2k  2  2 

(z,wHr 


(21  ) 


for  a  >  a  for  some  a  >  0  (By  (13,  Theorem  1]  and  since 
T 

min{q  z|w  =  Mz  +  q  >  0 ,  z  >  0}  =  0 ) 


•  max  {-  j-llMTr-aq+d#j  -  T  I -r+al^-qTr  |  (  a, d)  >  0)  (22) 
3k  ^  2  2  2 

(r,a,d)e  R 


(By  quadratic  programming  duality  [4,10]) 
( By  Lemma  1 ) 


=  min  f(r,a) 
reRk 


(23) 


=  •fi(a)  .  (24) 

This  establishes  (16)  and  (19).  Note  that  in  the  above  equalities  the  restriction  of  a 
to  a  >  a  is  only  needed  for  the  equality  between  (20)  and  (21),  otherwise  for  the 
equalities  between  (21)  and  up  to  (24)  a  is  unrestricted.  Because  the  quadratic  program 
(21)  is  feasible  and  its  dual  (22)  is  also  feasible  it  follows  that  the  objective  function 
of  (21)  is  bounded  below  [4,10  Theorem  8.2.3]  and  hence  (21)  has  a  solution  for  each  real 
a  [5].  By  virtue  of  the  equality  between  (21)  and  (24)  for  all  real  a  it  follows  that 
'r(a)  is  well  defined  for  all  real  a.  That  d(a)  is  convex  and  continuous  for  all  real 
a  follows  from  the  parametric  problem  representation  (21)  of  ^(a)  [ 9 ,  Theorem  1). 
Finally  (18)  follows  by  setting  a  =  0  in  (21).  f] 

By  using  results  of  perturbation  theory  of  convex  programs  |6,19]  we  can  give  a  useful 
stability  interpretation  of  a,  where  (r,a)  solves  (5). 

Corollary  3.  Let  the  linear  program  (1)  be  solvable.  For  6  >  0  let  (z(j),w(6))  be  the 
unique  solution  of  the  following  perturbation  of  the  minimum-norm  problem  (7) 
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12  T 

min  {j  lz,wl2 |w  =  Mz  +  q  >  0,  z  >  0,  q  z  <  6}  . 

(z,wK  R2k 


(25) 


Then  for  any  a  such  that  (r,a)  solves  (5) 


0  <  Hz(0),w<0)82  -  Iz(S)  ,w(6)  II2  <  2a6 


(26) 


and  if  q  *  0 


a6 


0  <  »z(0,/w(0>»2  -  »z<6)  ,w(«)«2  <  -#2{0)/W(0)# 


(27) 


Proof.  The  first  inequality  of  (26)  is  obvious  because  the  feasible  region  of  (25)  for 
6  >  0  contains  the  feasible  region  for  6  =  0.  The  second  inequality  of  (26)  follows 
from  the  standard  result  of  perturbation  theory  for  convex  programs  (6  Theorem  1,  19 

Theorem  29.1]  that  -a,  which  is  the  negative  of  an  optimal  multiplier  of  (25)  associated 

T  12 

with  q  z  <  6  for  6  =  0,  is  a  subgradient  of  the  convex  function  —  8 z  (6 )  ,w(6 )  II 2  at 

6  =  0. 

To  establish  (27)  we  note  that  for  6  >  0,  (z(6),w(6))  is  also  the  unique  solution  of 
the  convex  problem 

min  {lz,wl2|w  *  Mz  +  q  >  0,  z  >  0,  qTz  <  6}  (28) 

(z,w)e  R2k 

_  T 

and  if  q  *  0,  then  a/I z (0 ) ,w(0 ) *2  is  an  optimal  multiplier  associated  with  q  z  <  6 

for  6  =  0  in  the  optimization  problem  (28)  .  □ 

Inequality  (26)  states  that  for  an  error  of  no  more  than  6  in  satisfying  the 

equality  oondition  between  the  primal  and  dual  objective  functions,  that  is 

0  <  -cT x  +  bT u  =  qTz  <6,  the  square  of  the  2-norm  of  the  smallest  optimal  vector  of 

primal  and  dual  variables  and  slacks  of  the  linear  program  (1)  differs  by  no  more  than 

2a6  from  the  square  of  the  2-norm  of  the  corresponding  optimal  vector  for  which  q‘z  =  0 . 

It  follows  that  the  smaller  a  is  the  more  stable  is  the  linear  program  (1)  under  errors 

in  its  minimum  value.  Linear  programs  with  large  a  vrould  in  general  be  harder  to  solve 

than  those  with  small  a.  Computational  experience  in  [12]  where  a  perturbation  parameter 

e  was  used  which  is  related  to  —  bears  out  this  observation .  The  least  value  a  such 
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that  (r,a)  is  a  solution  of  (5)  may  be  thought  of  as  a  unique  stability  parameter 
associated  with  the  linear  program  (1),  and  because  of  (16),  it  may  be  defined  as 
min{a|^(a)  =  *>(a),  0  <  a  <  a}  .  Because  the  convex  set  {al^ta)  -  V>(a),  0  <  a  <  a)  is 
oompact,  in  fact  a  closed  line  interval,  a  is  well  defined.  By  the  equivalence  between 

(20)  and  (24),  a  can  also  be  defined  as  the  least  nonnegative  multiplier  associated  with 
T 

the  constraint  q  z  <  0  in  the  quadratic  program  (20).  Hence  (26)  and  (27)  can  be 
sharpened  by  replacing  a  by  a .  Related  but  different  results  for  perturbations  of 
linear  programs  are  given  in  [17). 

Going  back  to  the  unconstrained  minimization  problem  (5),  it  is  straightforward  to 
show  that  its  objective  function  f(r,a)  has  a  Lipschitz  continuous  gradient  if  we  make 

use  of  the  following  property  of  monotonic  norms  due  to  Y.-C.  Cheng  [1]  . 

4  £ 

Lemma  2  (Cheng)  .  For  any  monotonic  norm  1*1  on  R  and  any  a  and  b  in  R  it 
follows  that 


la  -  b+l  <  la  -  bl  . 

This  lemma  is  a  direct  consequence  of  the  inequality 

t*i  -  bj  -  l(a.  >+  -  <b.)  +  |  >0,  i  -  1 . £ 

and  the  norm  monotonicity .  The  Lipschitz  continuity  of  Vf(r,a)  can  be  easily  established 

by  using  Lemma  2  and  the  dual  vector  norm  1*1'  associated  with  any  given  vector  norm 

l  t  Z 

1*1  on  R  and  defined  by  Ixl'  =  sup  x  y  for  x  in  R  and  from  which  follows  the 

yeR2 

lyl-1 

T  Z 

generalized  Cauchy  inequality  x  y  <  Ixl'lyl'  for  all  x  and  y  in  R  .  For 

£ 

“  >  p,  q  >  1  and  (1/p)  +  (1/q)  =  1  and  any  x  in  R  ,  the  p-norm 
£  v 

:=  (  £  |x  |p>  p  and  the  q-norm  llxl  are  monotonic  and  dual  norms  to  each  other 
i=1  i 


Ixl 


P  iil  1  q 

[7,19]  .  By  using  the  generalized  Cauchy  inequality  and  Lemma  2  it  is  a  straightforward 
algebraic  exercise  to  obtain  the  following. 

1.^.  1 

Lemma  3 .  Let.  1*1  be  any  monotonic  norm  on  R  and  let  1*1'  be  its  dual  norm.  Then 


IVffr1,^)  -  Vf(r2,a2)l  <  Llfr'.a1)  -  (r2,a2)l 


1  1 


2  2  , 


for  all  (r  ,a  )  and  (r  ,a 


in 


R* 


+  1 


where 
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1 1  -limit 


T 


3  .  The  least-norm  linear  programming  solution  as  the  minimization  of  a  nonnegatively 


constrained  quadratic  function 

An  entirely  analogous  development  to  that  of  Section  2  but  which  is  based  on  (8) 
rather  than  (7)  leads  to  the  following  results  the  proofs  of  which  are  omitted. 

Theorem  2 .  The  dual  linear  programs  (1)  and  (2)  are  solvable  if  and  only  if  the  quadratic 
program  (9)  is  solvable.  For  any  solution  (s,t,0)  of  (10)  the  point  (z,w)  defined  by 


M^iS  -  0q  +  t. 


Mz  + 


(31) 


is  the  unique  point  in  R  which  solves  (3),  the  dual  linear  programs  ( 1 )— (2 )  and  the 
minimum-norm  problem  (8)  .  Furthermore 

min  g(s,t,3)  =  -  min  BzH^tw  =  Mz  +  q,  z  >  0,  qTz  *  0}  .  (32) 

(s,t#B)eR2k+1  (z,w)eR2k 

(s,t,B)>0 


Corollary  4 .  Let  {z|Mz  +  q  >  0,  z  >  0}  be  nonempty  and  let  g  be  defined  by  (10) . 
There  exists  a  8  >  0  such  that 

min  g(s,t,8)  “  ♦  (B)  for  B  >  B  (33) 

,  „2k  +1 

(s,t,B)eR 

(s,t,B)>0 


where 


\)i(6)  :  =  min  g(s,t,B) 

(s,t)eR2k 

(s,t)>0 


is  well  defined,  continuous  and  convex  for  all  real  6  and 

\p(0)  “  -  min  Izl2  |Mz  q  >  0 ,  z  >  0}  , 


ze  R 


i)i(B)  *  -  min  {•j  lzl2|Mz  +  q  >  0,  z  >  0,  qTz  =  0}  for  8  >  6  • 
k  2  2 

ze  R 
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Coronary  S.  Let  the  linear  program  (1)  be  solvable.  For  6  >  0  let  z ( 6 )  be  the  unique 

solution  of  the  following  perturbation  of  the  minimum  norm  problem  (8) 

12  T 

min  {-  Izl  |Mz  +  q  >  0,  a  >  0,  q  z  <  «}  . 

k 

ze  R 


Then  for  any  $  such  that  (s,t,fT)  solves  (9) 


and 


if  q/ 


0  <  laid)!*  -  »z(S)l*  <  2 66 


o  <  .z«o)i2  -  <  TO57I-  • 


The  least  value  8  such  that  (s,t,8)  is  a  solution  of  (9)  may  also  be  considered  a 
stability  parameter  for  the  linear  program  (1)  and  may  be  defined  as  min{8l+(6)  -  \ H8)  . 

0  <  8  <  8)  where  8  is  defined  in  (33)  .  Alternatively  8  may  be  taken  as  the  least 
nonnegative  multiplier  associated  with  the  constraint  qTz  <0  in  the  quadratic  program 
(8)  . 


I 


I 


f  « 


i 

r 
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4.  Computational  implications 

The  reformulation  of  the  linear  program  (1)  as  an  unconstrained  minimization  problem 
(5)  or  as  a  quadratic  program  (9)  is  not  merely  of  theoretical  interest  but  may  also  have 

computational  potential.  For  example,  the  simple  gradient  algorithm  [8,16] 

,  i+1  i+1 ,  ,  i  i,  i  i,  .  „  . 

(r  ,a  )  =  (r  ,a  )  -  yVf(r  ,a  ),  i  «  0,1,... 

where  \  (34) 


0  <  y  <  2/1*2  and 


1  +  ( iMl 2  +  «ql2) 


will  generate  a  sequence  {(r*,a*)},  i  =  0,1,...,  in  R*c+1  starting  from  any  point 
(r°,a°)  in  Rk+1  which  will  converge  to  a  solution  (r,a)  of  (5)  [16]  if  the  linear 
program  ( 1 )  has  a  solution.  The  convergence  however  may  be  slow  and  the  error  is  bounded 


by  [16] 


i 

e  < 


<e°  )_1  +  pi 


(35) 


i  i  i  ^'2  - 

where  e  :»  f(r  ,a  )  -  f(r,a)  and  p  »  - - — - - — - -  .  It  would  be  very 

2 1  ( r  , a  )  -  (ir  ,a)  I2 

interesting  to  develop  faster  and  possibly  finite  methods  for  solving  (5). 

Similarly  problem  (9)  may  be  solved  by  the  successive  overrelaxation  (SOR)  or  other 
iterative  methods  of  [11).  However,  one  would  be  working  in  the  space  R2k+1  =  jj2(m+n)  +  1 
which  is  of  higher  dimension  than  that  of  the  space  Rn+m  of  (1).  Other  SOR  methods  for 
solving  linear  programs  have  been  developed  elsewhere  [12]  which  do  not  enlarge  the  space 
of  the  original  problem,  however  they  contain  an  unknown  but  finite  perturbation  or  penalty 
parameter.  The  formulation  (9)  gets  rid  of  the  parameter  at  the  expense  of  enlarging  the 
space  of  the  problem.  Another  possible  method  for  solving  (9)  is  the  conjugate  gradient 
method  [15,14] . 
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